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Olia  Lialina  &  Dragan  Espenschied: 
"Rich  User  Experience"  from  the 
series  With  Elements  of  Web  2.0, 
2006. 


"If  we  only  look  through  the 
interface  we  cannot  appreci¬ 
ate  the  ways  in  which  it 
shapes  our  experience"1 2 


I'm  talking  as  the  Geocities  Institute's 
Head  of  Research,  an  advocate  for 
computer  users'  rights,  and  interface 
design  teacher. 


RUE 

I've  been  making  web  pages  since 
1995,  since  2000  I'm  collecting  old  web 
pages,  since  2004  I’m  writing  about 
native  web  culture  (digital  folklore) 


and  the  significance  of  personal 
home  pages  for  the  web’s  growth,  per¬ 
sonal  growth  and  development  of 
HCI. 

So  I  remember  very  well  the  moment 
when  Tim  O'Reilly  promoted  the 
term  Web  2.0  and  announced  that  the 
time  of  Rich  User  Experience  has 
begun.  This  buzzword  was  based 
on  Rich  Internet  Applications,  coined 
by  Macromedia, 2  that  literally  meant 
their  Flash  product.  O’Reilly’s  RUE 
philosophy  was  also  rather  technical: 
The  richness  of  user  experiences 
would  arise  from  of  use  of  AJAX, 
Asynchronous  Javascript  and  XML. 
The  web  was  supposed  to  become 
more  dynamic,  fast  and  "awesome,” 
because  many  processes  that  users 
would  have  to  consciously  trigger  be¬ 
fore,  started  to  run  in  the  background. 
You  didn't  have  to  submit  or  click  or 
even  scroll  anymore,  new  pages, 
search  results  and  pictures  would  ap¬ 
pear  by  themselves,  fast  and  seam¬ 
less.  "Rich"  meant  "automagic"  and  ... 
as  if  you  would  be  using  desktop  soft¬ 
ware.  As  Tim  O’Reilly  states  in  Sep¬ 
tember  2005  in  blogpost  What  is  Web 
2.0?:3  "We  are  entering  an  unprece¬ 
dented  period  of  user  interface  inno¬ 
vation,  as  web  developers  are  finally 
able  to  build  web  applications  as  rich 
as  local  PC-based  applications."4 

But  Web  2.0  was  not  only  about  a  new 
way  of  scripting  interactions.  It  was 
an  opportunity  to  become  a  part  of  the 


1  Gromala  Bolter,  Windows  and  Mirrors 
(Cambridge,  MA:  MIT  Press,  2003). 

2  Jeremy  Allaire,  "Macromedia  Flash  MX-A 
next-generation  rich  client,"  Macromedia  whitepaper 
(San  Francisco:  Macromedia,  2002). 

3  Tim  O'Reilly,  “What  is  Web  2.0,”  O'Reilly, 

2005, 


http://www.oreilly.com/pub/a/web2/archive/what-is- 

web-20.html?page=5. 

4  A  decade  later,  when  "the  cloud”  has 
become  the  symbol  of  power  and  the  desktop 
metaphor  is  getting  obsolete,  this  comparison  looks 
almost  funny.  As  this  article  seeks  to  demonstrate, 
the  power  of  the  desktop  should  not  be 
underestimated. 
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internet  also  automagically.  No  need 
to  learn  HTML  or  register  a  domain  or 
whatever,  Web  2.0  provided  pre-made 
channels  for  self  expression  and 
communication,  hosting  and  sharing. 
No  need  anymore  to  be  your  own  in¬ 
formation  architect  or  interface  de¬ 
signer,  looking  for  a  way  to  deliver 
your  message.  In  short:  no  need  to 
make  a  web  page. 

The  paradox  for  me  at  that 
time  was  that  Rich  User  Experi¬ 
ence  was  the  name  for  a  reality  where 
user  experiences  were  getting  poorer 
and  poorer.  You  wouldn't  have  to 
think  about  web  or  web  specific  activ¬ 
ities  anymore.  Also,  Web  2.0  was  the 
culmination  of  approximately  seven 
years  of  neglecting  and  denying  the 
experience  of  web  users— where  ex¬ 
perience  is  Erfahrung,  rather 
than  Erlebnis.5  So  layouts,  graphics, 
scripts,  tools  and  solutions  made  by 
naive  users  were  neither  seen  as  a 
heritage  nor  as  valuable  elements  or 
structures  for  professional  web  pro¬ 
ductions. 

That's  why  designers  of  today  are  cer¬ 
tain  that  responsive  design  was  in¬ 
vented  in  2010,  mixing  up  the  idea 
with  coining  the  term;  though  it  was 
there  from  at  least  1994. 

And  it  also  explains  why  the  book  De¬ 
signing  for  Emotion6  from  the  very 
sympathetic  series  "books  apart” 
gives  advises  how  to  build  a  project 
"from  human  to  human”  without  even 
mentioning  that  there  is  much  expe¬ 
rience  of  humans  addressing  hu¬ 
mans  on  the  web  that  is  decades  old. 
"Guess  what?!  I  got  my  own  domain 
name!”  announces  the  proud  user 


who  leaves  Geocities  for  a  better 
place.  -  "So  if  you  came  here  through 
a  link,  please  let  that  person  know 
they  need  to  change  their  link!" 

"If  you  take  the  time  to  sign  my  guest 
book  I  will  e-mail  you  in  return." 
writes  another  user  in  an  attempt  to 
get  feedback.  Well,  this  one  might  be 
more  of  an  example  for  early  gamifi- 
cation  than  emotional  design,  but  this 
direct  human  to  human  communica¬ 
tion-something  current  designers 
have  the  largest  desire  to  create-is 
very  strong. 

A  few  days  ago,  my  team  at 
the  Geocities  Research  Institute 
found  700  answers  to  the  question 
"What  did  peeman  pee  on?"  Peeman  is 
an  animated  GIF  created  by  an  un¬ 
known  author,  widely  used  on 
"manly”  neighborhoods  of  Geocities 
to  manifest  disgust  or  disagreement 
with  some  topic  or  entity,  like  a  sports 
team,  a  band,  a  political  party,  etc., 
kind  of  a  "dislike"  button. 

It  isn't  a  particularly  sophisticated 
way  to  show  emotions  or  manifest  an 
attitude,  but  still  so  much  more  inter¬ 
esting  and  expressive  than  what  is 
available  now:  First  of  all,  because  it  is 
an  expression  of  a  dislike,  when  today 
there  is  only  an  opportunity  to  like. 
Second,  the  statement  lays  outside  of 
any  scale  or  dualism:  the  dislike  is  not 
the  opposite  of  a  like.  Third:  it  is  not  a 
button  or  function,  it  works  only  in 
combination  with  another  graphic  or 
word.  Such  a  graphic  needed  to  be 
made  or  found  and  collected,  then 
placed  in  the  right  context  on  the 
page— all  done  manually. 


5  Wiktionary  explains  the  different  possible  6  Aaron  Walter,  Designing  for  Emotion  (New 

meanings  of  "experience”  in  the  English  language.  York:  A  Book  Apart,  2011). 
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I  am  mainly  interested  in  early  web 
amateurs  because  I  strongly  believe 
that  the  web  in  that  state  wasthe 
culmination  of  the  Digital  Revolu¬ 
tion.7 

And  I  don't  agree  that  the  web  of  the 
1990's  can  just  be  considered  as  a 
short  period  before  we  got  real  tools, 
an  exercise  in  self-publishing  before 
real  self-representation.  I'd  like  to  be¬ 
lieve  that  15  years  of  not  making  web 
pages  will  be  classified  as  a  short  pe¬ 
riod  in  the  history  of  the  WWW. 

There  are  a  few  initiatives  right 
now  supporting  my  observation  that 
home  page  culture  is  having  a  second 
come  back,  this  time  on  a  structural 
rather  than  just  visual  level.8 

•  neocities.org  -  free  HTML  de¬ 
sign  without  using  templates. 

•  tilde. club  -  as  the  above,  plus 
URLs  as  an  expression  of  us¬ 
ers  belonging  to  a  system;  and 
web-rings  as  an  autonomy  in 
hyper  linking. 

•  superglue.it  -  "Welcome  to 
my  home  page"  taken  to  the 
next  level,  by  hosting  your 
home  page  at  your  actual 
home. 

k  k  k 

I  had  the  chance  to  talk  at  the  launch 
of  superglue.it  at  WORM  in  Rotterdam 
a  month  ago.  Five  minutes  before  the 
event,  team  members  were  thinking 
who  should  go  on  stage.  The  graphic 
designer  was  not  sure  if  she  should 
present.  "I've  only  made  icons,"  she 


said.  "Don’t  call  them  Icons,"  the  team 
leader  encouraged  her,  "call  them 
User  Experience!”  And  his  laughter 
sunk  in  with  everybody  else's. 

EXPERIENCE 
DESIGN  AND  USER 
ILLUSION 

We  laughed  because  if  you  work  in 
new  media  design  today,  you  hear 
and  read  and  pronounce  this  word 
every  day.  Rich  User  Experience 
maybe  was  a  term  that  kept  its  propo¬ 
nents  and  critics  busy  for  some  time, 
but  it  never  made  it  into  mainstream 
usage,  it  was  always  overshadowed 
by  Web  2.0. 

With  User  Experience  (UXD,  UX,  XD)  it 
is  totally  different: 

The  vocabulary  of  HCI,  Human  Com¬ 
puter  Interaction  design,  that  has 
been  only  growing  since  its  inception, 
keeps  shrinking  since  two  years.  For¬ 
get,  input  and  output,  virtual  and  aug¬ 
mented,  focus  and  context,  front-end 
and  back-end,  forms,  menus  and 
icons. 


7  ...  as  opposed  to  Chris  Anderson  and 
Michael  Wolff,  "The  Web  Is  Dead.  Long  Live  the 
Internet,"  Wired,  last  modofoed  August  17,  2010, 
https://www.wired.eom/2010/08/ff_webrip/all/1/. 

8  The  first  comeback  was  around  five  years 
ago  when  designers  started  to  pay  attention  to 


elements  of  the  early  web:  animated  GIFs,  under 
construction  signs.  See  Olia  Lialina,  "Geocities  as 
Style  and  Marketing  Gimmick  (ffidivshot,"  One 
Terabyte  of  Kilobyte  Age,  April  4, 2013, 
http://blog. geocities. institute/archives/3844. 
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Homepage,  last  modified  1  999-07-1  5 
17:43:15,  from  the  Geocities  Re¬ 
search  Institute  collection 


Peeman  as  seen  in  the  exhibition 
"Digitale  Folklore",  Dortmund,  2015. 
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This  all  is  experience  now.  Designers 
and  companies  who  were  offering 
web/interface  solutions  a  year  ago 
are  now  committed  to  UX. 

Former  university  media  de¬ 
sign  departments  are  becoming  UX 
departments.  The  word  interface  is 
substituted  by  experience  in  journal¬ 
istic  texts  and  conference  fliers. 
WYSIWYG  becomes  "complete  drag 
and  drop  experience,"  as  a  web  pub¬ 
lishing  company  just  informed  me  in 
an  email  advertising  their  new  prod¬ 
uct.9 


Fields  of  User  Experience  Design 


Source:  Elizabeth  Bacon,  Defining  UX, 
Devise  Consulting,  2014-01-28. 

UX  is  not  new,  the  term  is  fully 
fledged.  It  was  coined  by  Don  Norman 
in  1993  when  he  became  a  head  of  Ap¬ 
ple's  research  group:  "I  invented  the 
term  because  I  thought  human  inter¬ 
face  and  usability  were  too  narrow.  I 


9  Weebly,  Inc.,  "Introducing  Weebly  for  iPad,” 
Weebly  newsletter,  received  by  author  on  November 
16,2014. 

10  Peter  Merholz,  "Peter  in  Conversation  with 

Don  Norman  About  UX  &  Innovation,”  Adaptive  Path, 


wanted  to  cover  all  aspects  of  the  per¬ 
son’s  experience  with  the  system  in¬ 
cluding  industrial  design  graphics, 
the  interface,  the  physical  interaction 
and  the  manual."10 

Recalling  this  in  2007,  he  added: 
"Since  then  the  term  has  spread 
widely,  so  that  it  is  starting  to  lose  its 
meaning."  Other  prophets  are  com¬ 
plaining  for  years  already  that  not 
everybody  who  calls  themselves  "ex¬ 
perience  designer"  actually  practices 
it. 

This  is  business  as  usual,  terms  ap¬ 
pear,  spread,  transform,  become  idi¬ 
oms;  the  older  generation  unhappy 
with  the  younger  one,  etc.  I  don't  bring 
this  up  to  distinguish  "real"  and  "fake” 
UX  designers. 

I'm  concerned  about  the  design  para¬ 
digm  that  bears  this  name  at  the  mo¬ 
ment,  because  it  is  too  good  at  serving 
the  ideology  of  Invisible  Computing. 
As  I  argued  in  Turing  Complete 
User,11  the  word  "experience"  is  one  of 
three  words  used  today  referring  to 
the  main  actors  of  HCI: 


HCI 

UX 

Computer 

Technology 

Interface 

Experience 

Users 

People 

last  modified  December  13,  2007, 
http://adaptivepath.org/ideas/e000862/. 

11  Olia  Lialina,  "Turing  Complete  User,”  October 
2012,  http://contemporary-home- 
computing.org/turing-complete-user/. 
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The  role  of  "experience"  is  to  hide  pro¬ 
grammability  or  even  customizability 
of  the  system,  to  minimize  and  chan¬ 
nel  users'  interaction  with  the  sys¬ 
tem. 

"User  illusion”  was  a  main  principle  of 
interface  designers  since  XEROX 
PARC,  since  the  first  days  of  the  pro¬ 
fession.  They  were  fully  aware  about 
creating  illusions,  of  paper,  of  folders, 
of  windows.  UX  creates  an  illusion  of 
unmediated  natural  space.12 
UX  covers  holes  in  Moore's  Law;  when 
computers  are  still  bigger  than  ex¬ 
pected,  it  can  help  to  shrink  them  in 
your  head.  UX  fills  awkward  mo¬ 
ments  when  AI  fails.  It  brings  “user  il¬ 
lusion"  to  a  level  where  users  have  to 
believe  that  there  is  no  computer,  no 
algorithms,  no  input.  It  is  achieved  by 
providing  direct  paths  to  anything  a 
user  might  want  to  achive,  by  script¬ 
ing  the  user13  and  by  making  an  effort 
on  audiovisual  and  aesthetic  levels  to 
leave  the  computer  behind. 

The  "Wake-up  Light”  by  Philips  is  an 
iconic  object  that  is  often  used  as  an 
example  of  what  experience  design 
is.  It  is  neither  about  its  look  nor  inter¬ 
action,  but  about  the  effect  it  pro¬ 
duces:  a  sunrise.  The  sunrise  is  a 
natural,  glorious  phenomenon,  as  op¬ 
posed  to  artificial  computer  effects 
created  from  pixels,  or,  let's  say,  the 
famous  rain  of  glowing  symbols  from 
The  Matrix.  Because  an  experience  is 


only  an  experience  when  it  is  "natu¬ 
ral." 

There  is  no  spoon.  There  is  no  lamp. 


Source:  Philips'  promotional  image 
for  Wake-up  Light,  2010,  lifted 
from  Amazon. 

When  Don  Norman  himself  describes 
the  field,  he  keeps  it  diplomatic:  "[W]e 
can  design  in  the  affordances  of 
experiences,  but  in  the  end  it  is  up  to 
the  people  who  use  our  products  to 
have  the  experiences.”14— Of  course, 
but  affordances  are  there  to  align  the 
users'  behaviors  with  a  direct  path.  So 
it  is  not  really  up  to  the  "people,”  but 
more  up  to  the  designer. 


12  Alan  Kay,  “User  Interface:  A  Personal  View," 
in  The  Art  of  Human-Computer  Interface  Design,  eds. 
Brenda  Laurel  and  S.  Joy  Mountford  (Reading,  MA: 
Addison  Wesley  1990),  191 -207. 

1 3  Janet  Murray,  Hamlet  on  the  Holodeck  (New 
York:  The  Free  Press,  1 997).  In  later  editions  of  the 
book  and  her  recent  writings  she  refers  to  this 
concept  as  scripting  the  interactor. 

14  Donald  A.  Norman,  "Commentary  on: 
Hassenzahl,  Marc  (2014):  User  Experience  and 


Experience  Design,"  in  The  Encyclopedia  of  Human- 
Computer  Interaction,  2nd  edition,  eds.  Mads 
Soegaard  and  Rikke  Friis  Dam  (Aarhus:  The 
Interaction  Design  Foundation,  2014), 
https.V/www.interaction- 
design.org/literature/book/the-encyclopedia-of- 
human-computer-interaction-2nd-ed/user- 
experience-and-experience-design. 
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One  of  the  world’s  most  convincing 
experience  design  proponents,  Marc 
Hassenzahl,  clearly  states:  "We  will 
inevitably  act  through  products,  a 
story  will  be  told,  but  the  product  itself 
creates  and  shapes  it.  The  designer 
becomes  an  'author'  creating  rather 
than  representing  experiences.”15 
That's  very  true.  Experiences  are 
shaped,  created  and  staged.  And  it 
happens  everywhere: 

On  vine,  when  commenting  on  an¬ 
other  user's  video,  you  are  not  pre¬ 
sented  with  an  empty  input  form,  but 
are  overwriting  the  suggestion  “say 
something  nice.” 


#geocities  #collegepark  #field  #7933 

©  3  ©  17  ©  Share 


Screenshot  of  vine.co,  taken  2015- 
01-02. 

On  Tumblr,  a  "close  this  window"  but¬ 
ton  becomes  "Oh,  fine.”  I  click  it  and 
hear  the  UX  expert  preaching:  “Don’t 
let  them  just  close  the  window,  there 
is  no  ‘window,’  no  ‘cancel’  and  no 
'OK.'  People  should  greet  the  new  fea¬ 
ture,  they  should  experience  satisfac¬ 
tion  with  every  update!" 

As  the  Nielsen  Norman  Group  puts  it: 
"User  experience  design  (UXD  or  UED) 
is  the  process  of  enhancing  user  sat¬ 
isfaction  by  improving  the  usability, 
ease  of  use,  and  pleasure  provided  in 


the  interaction  between  the  user  and 
the  product.”16 


Quick  li’l  note:  To  keep  things 
tidy,  we've  moved  Settings  and 
Help  into  here. 


Oh,  fine 


Screenshot  of  tumblr.com,  taken 
2014-12-28. 

Such  an  experience  can  be  orches¬ 
trated  on  a  visual  level:  In  web  design, 
video  backgrounds  are  masterly  used 
today  to  make  you  feel  the  depth,  the 
bandwidth,  the  power  of  a  service 
like  airbnb,  to  bring  you  there,  to  the 
real  experience.  On  the  structural 
level,  a  good  example  is  how  facebook 
three  years  ago  changed  you  tool  for 
everyday  communication  into  a  tool 
to  tell  the  story  of  your  life  with  their 
"timeline." 

You  experience  being  heard  when 
Siri  got  a  human  voice,  and  an  ulti¬ 
mate  experience  when  this  voice  is 
calm,  whatever  happens.  (The  only 
thing  that  actually  ever  happens  is 
SIRI  not  understanding  what  you  say, 
but  she  is  calm!) 

You  experience  being  needed  and 
loved  when  you  hold  PARO,  the  most 
sold  lovable  robot  in  the  world,  be¬ 
cause  it  has  big  eyes  that  look  into 
your  eyes.  And  you  can  pet  its  nice 
fur.  Though  smart  algorithms,  lifelike 


15  Ibid.  http://web.archive.Org/web/19981201051931/http.7/ 

16  The  Nielsen  Norman  Group's  defintion  www.nngroup.com/about/userexperience.html. 

of  User  Experience  dates  back  to  December  1 998, 
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appearance  and  behavior  alone 
wouldn’t  suffice  to  not  make  users 
feel  like  consumers  of  a  manufac¬ 
tured  programmable  system. 

Critics  of  AI  like  Sherry  Turkle  warn 
that  we  must  see  and  accept  ma¬ 
chines'  "ultimate  indifference,”17  but 
today's  experience  designers  know 
how  to  script  the  user  to  avoid  any 
gaps  in  the  experience.  There  is  no 
way  to  get  out  of  this  spectacle.  When 
PARO  is  out  of  battery,  it  needs  to  be 
charged  via  a  baby’s  dummy  plugged 
into  its  mouth.  If  you  possess  this  pre¬ 
cious  creature,  you  experience  its  life¬ 
lines  even  when  it  is  just  a  hairy 
sensors  sandwich. 


Source:  PARO  Robots,  Robo  Japan 
2008  exhibition. 

This  approach  leads  to  some  great 
products  on  screen  and  IRL,  but  alien¬ 
ates  as  well.  Robotics  doesn't  give  us 
a  chance  to  fall  in  love  with  the  com¬ 
puter  if  it  is  not  anthropomorphic.  Ex¬ 
perience  design  prevents  from 
thinking  and  valuing  computers  as 
computers,  and  interfaces  as  inter¬ 
faces.  It  makes  us  helpless.  We  lose 


an  ability  to  narrate  ourselves  and— 
going  to  a  more  pragmatic  level— we 
are  not  able  to  use  personal  comput¬ 
ers  anymore. 

We  hardly  know  how  to  save  and 
have  no  idea  how  to  delete.  We  can’t 
UNDO! 

k  k  k 

UNDO  was  a  gift  from  developers  to 
users,  a  luxury  a  programmable  sys¬ 
tem  can  provide.  It  became  an  every¬ 
day  luxury  with  the  first  GUI 
developed  at  Xerox18  and  turned  into 
a  standard  for  desktop  operating  sys¬ 
tems  to  follow.  Things  changed  only 
with  the  arrival  of  smart  phones:  nei¬ 
ther  Android  nor  Windows  phone  nor 
Blackberry  provide  a  cross-applica¬ 
tion  alternative  to  CTRL+Z.  iPhones 
offer  the  embarrassing  "shake  to 
undo." 

What  is  the  reasoning  of  these  de¬ 
vices'  developers? 

Not  enough  space  on  the  nice  touch 
surface  for  undo  button;  the  idea  that 
users  should  follow  some  exact  path 
along  the  app's  logic,  which  would 
lead  somewhere  anyway;  the  promise 
that  the  experience  is  so  smooth  that 
you  won't  even  need  this  function. 

Should  we  believe  it  and  give  up?  No! 
There  are  at  least  three  reasons  why 
to  care  about  UNDO: 

1.  UNDO  is  one  of  very  few  ge¬ 
neric  ("stupid”)  commands.  It 
follows  a  convention  without 


17  Sherry  Turkle,  Alone  Together.  WhyWe  18  Butler  Lampson  and  Ed  Taft,  Alto  User's 

Expect  More  from  Technology  and  Less  from  Each  Handbook,  (Palo  Alto:  Xerox  Corporation,  1 979),  36. 

Other  (New  York:  Basic  Books,  2011),  133. 
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sticking  its  nose  into  the 
user's  business. 

2.  UNDO  has  a  historical  im¬ 
portance.  It  marks  the  begin¬ 
ning  of  the  period  when 
computers  started  to  be  used 
by  people  who  didn’t  program 
them,  the  arrival  of  the  real 
user19,  and  the  naive  user.  The 
function  was  first  mentioned 
in  the  IBM  research  report  Be¬ 
havioral  Issues  in  the  Use  of 
Interactive  Systems:20  They 
outlined  the  necessity  to  pro¬ 
vide  future  users  with  UNDO: 
"the  benefit  to  the  user  in  hav¬ 
ing— even  knowing— of  a  ca¬ 
pability  to  withdraw  a 
command  could  be  quite  im¬ 
portant  (e.g,  easing  the  acute 
distress  often  experienced  by 
new  users,  who  are  worried 
about  'doing  something 
wrong').1' 

3.  UNDO  is  the  border-line  be¬ 
tween  the  Virtual  and  the  Real 
World  everybody  is  keen  to 
grasp.  You  can't  undo  IRL.  If 
you  can't  undo  it  means  you 
are  IRL  or  on  Android. 

-k  -k  -k 

In  August  2013,  The  Guardian  re¬ 
ceived  an  order  to  destroy  the  com¬ 
puter  on  which  Snowden's  files  were 
stored.  In  mass  media  we  saw  explicit 
pictures  of  damaged  computer  parts 


and  images  of  journalists  executing 
drives  and  chips  and  heard  Guard¬ 
ian's  Editor  in  Chief  saying:  "It's 
harder  to  smash  up  a  computer  than 
you  think.”  And  it  is  even  harder  to  ac¬ 
cept  it  as  a  reality. 

For  government  agencies,  the  de¬ 
struction  of  hardware  is  a  routine  pro¬ 
cedure.  From  their  perspective,  the 
case  of  deletion  is  thoroughly  dealt 
with  when  the  media  holding  the  data 
is  physically  gone.  They  are  smart 
enough  to  not  trust  the  "empty  trash” 
function. 

Of  course  the  destruction  made  no 
sense  in  this  case,  since  copies  of  the 
files  in  question  were  located 
elsewhere,  but  it  is  a  great  symbol  for 
what  is  left  for  users  to  do,  what  is  the 
last  power  users  have  over  their  sys¬ 
tems:  They  can  only  access  them  on 
the  hardware  level,  destroy  them. 
Since  there  is  less  and  less  certainty 
of  what  you  are  doing  with  your  com¬ 
puter  on  the  level  of  software,  you'll 
tend  to  destroy  your  hard  drive  volun¬ 
tarily  every  time  you  want  to  really 
delete  something. 

Classic  images  of  the  first  ever  com¬ 
puter  ENIAC  from  1945  show  a  system 
maintained  by  many  people  who  re¬ 
wire  or  rebuild  it  for  every  new  task. 
ENIAC  was  operated  on  the  level  of 
hardware,  because  there  was  no  soft¬ 
ware.  Can  it  be  that  this  is  the  future 
again? 


19  See  Olia  Lialina,  "Users  Imagined,"  appendix 
to:  “Turing  Complete  User”,  October  2012, 
http://contemporary-home-computing.org/turing- 
complete-user/. 


20  Lance  A.  Miller  and  John  C.  Thomas  Jr„ 
"Behavioral  issues  in  the  use  of  interactive  systems,” 
in  Interactive  Systems.  IBM  1976.  Lecture  Notes  in 
Computer  Science,  vol49,  eds.  A.  Blaser  and  C.  Hackl 
(Berlin,  Heidelberg:  Springer  1977),  193-216. 
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Source:  Frank  da  Cruz:  Programming 
the  ENIAC,  2003 

http://www.columbia.edu/cu/compu- 

tinghistory/eniac.html 
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In  2011,  66  years  after  ENIAC,  Proto- 
Dojo  showcased  a  widely  celebrated 
"hack”  to  control  an  iPad  with  a  vin¬ 
tage  NES  video  game  controller.  The 
way  to  achieve  this  was  to  build  arti¬ 
ficial  fingers,  controlled  by  the  NES 
joypad,  to  touch  the  iPads  surface; 
modifying  the  hardware  from  the  out¬ 
side,  because  everything  else,  espe¬ 
cially  the  iPad's  software,  is  totally 
inaccessible. 


Source:  Protodojo:  RoboTouch  iPad 
Controller,  201  1-08-21. 


Having  said  that,  I’d  like  to  add  that 
HCI  designers  have  huge  power,  and 
seem  unaware  about  it  often.  Many  of 
those  who  design  interfaces  never 
studied  interface  design,  many  of 
those  who  did  didn't  study  its  history, 
never  read  Alan  Kay's  words  about 
creating  the  "user  illusion,"  didn't 
question  this  paradigm  and  didn't  re¬ 
flect  on  their  own  decisions  in  this 
context.  And  not  only  interface  de¬ 
signers  should  be  educated  about 
their  role,  but  it  should  be  discussed 
and  questioned  which  tasks  can  be 
delegated  to  them  in  general.  Where 
are  the  borders  of  their  responsibili¬ 
ties? 

COMBAT  STRESS 
AND  THE 
DESKTOPIZATION 
OF  WAR 


Every  victory  of  experience  design:  a 
new  product  "telling  the  story,"  or  an 
interface  meeting  the  "exact  needs  of 
the  customer,  without  fuss  or  bother” 
widens  the  gap  in  between  a  person 
and  a  personal  computer. 

The  morning  after  "experience  de¬ 
sign:"  interface-less,  deposible  hard¬ 
ware,  personal  hard  disc  shredders, 
primitive  customization  via  mechan¬ 
ical  means,  rewiring,  reassembling, 
making  holes  into  hard  disks,  in  order 
to  to  delete,  to  logout,  to  "view  offline." 

-k  -k  -k 


In  2013,  Dr.  Scott  Fitzsimmons  and 
MA  graduate  Karina  Sangha 
published  the  paper  Killing  in  High 
Definition.  They  rose  the  issue  of 
combat  stress  among  operators  of 
armed  drones  (Remote  Piloted 
Aircrafts)  and  suggested  ways  to 
reduce  it.  One  of  them  is  to  Mask 
Traumatic  Imagery. 

To  reduce  RPA  operator 
s'  exposure  to  the  stress-inducing 
traumatic  imagery  associated  with 
conducting  airstrikes  against  human 
targets,  the  USAF  should  integrate 
graphical  overlays  into  the  visual 
sensor  displays  in  the  operators'  vir¬ 
tual  cockpits. 
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These  overlays  would,  in  real-time, 
mask  the  on-screen  human  victims 
of  RPA  airstrikes  from  the  operators 
who  carry  them  out  with  sprites  or 
other  simple  graphics  designed  to  de¬ 
humanize  the  victims’  appearance 
and,  therefore,  prevent  the  operators 
from  seeing  and  developing  haunting 
visual  memories  of  the  effects  of  their 
weapons. 

I  had  students  of  my  interface 
design  class  read  this  paper.  I  asked 
them  to  imagine  what  this  masking 
could  be.  After  hesitation  to  even 
think  in  this  direction,  their  first  draft 
were  alluding  to  the  game  SIMS: 


Of  course  the  authors  of  this  paper  are 
not  ignorant  or  evil.  A  paragraph  be¬ 
low  the  quoted  one  they  state  that 
they're  aware  that  their  ideas  could  be 
read  as  advocacy  for  a  "play  station 
mentality,"  and  note  that  RPA  opera¬ 
tors  don't  need  artificial  motivation  to 


kill,  they  know  what  they  are  doing. 
To  sum  it  up,  there  is  no  need  for 
a  gamification  of  war,  it  is  not  about 
killing  more  but  about  feeling  fine  af¬ 
ter  the  job  is  done. 

I  think  that  this  paper,  its  attitude,  this 
call  to  solve  immense  psychiatric 
task  on  the  level  of  the  interface  made 
me  see  HCI  in  a  new  light. 

Since  the  advent  of  the  Web,  new  me¬ 
dia  theoreticians  were  excited  about 
convergence:  you  have  the  same  in¬ 
terface  to  shop,  to  chat,  to  watch  a 
film  ...  and  to  launch  weapons,  I  could 
continue  now.  It  wouldn't  be  really 
true,  drone  operators  use  other  inter¬ 
faces  and  specialized  input  devices. 
Still,  as  on  the  image  above,  they  are 
equipped  with  the  same  operating 
systems  running  on  the  same  moni¬ 
tors  that  we  use  at  home  and  the  of¬ 
fice. 

But  this  is  not  the  issue,  the  conver¬ 
gence  we  can  find  here  is  even  more 
scary:  the  same  interface  to  navigate, 
kill  and  to  cure  post  traumatic  stress. 

Remember  Weizenbaum  re¬ 
acting  furiously  to  Colby's  plans  of 
implementing  the  Eliza  chatbot  in  ac¬ 
tual  psychiatric  treatments?  He 
wrote:  "What  must  a  psychiatrist 
think  he  is  doing  while  treating  a  pa¬ 
tient  that  he  can  view  the  simplest 
mechanical  parody  of  a  single  inter¬ 
viewing  technique  as  having  cap¬ 
tured  anything  of  the  essence  of  a 
human  encounter."21  Weizenbaum 
was  not  asking  for  better  software  to 
help  curing  patients,  he  was  rejecting 
the  core  idea  to  use  algorithms  for 
this  task. 


21  Josef  Weizenbaum,  "From  Judgement  to  Noah  Wardrip-Fruin  and  Nick  Montfort  (Cambridge, 

Calculation  [1 976],”  in  The  New  Media  Reader,  eds.  MA:  MIT  Press,  2003),  370. 


188 


LIALINA:  RICH  USER  EXPERIENCE 


Michael  Shoemaker:  MQ-9  Reaper 
training  mission  from  a  ground  con¬ 
trol  station  on  Holloman  Air  Force 
Base,  N.M.,  2012 
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It  is  an  ethical  rather  than  a  technical 
or  design  question,  just  like  the  mask¬ 
ing  of  traumatic  imagery  is  now. 

If  we  think  about  the  current  state 
of  the  art  in  related  fields,  we  see  on 
the  technological  level  everything  is 
already  in  place  for  the  computer  dis¬ 
play  acting  as  a  gun  sight  and  at  the 
same  time  as  a  psychotherapist 

coach. 

•  There  are  tests  to  cure  PTSD 
in  virtual  reality,  and  studies 
that  report  about  successes. 
So  there  is  believe  in  VR's 
healing  abilities.22 

•  There  are  a  lot  of  examples 
around  in  gaming  and  mobile 
apps  proving  that  the  real 
world  can  be  augmented  with 
generated  worlds  in  real 
time.23 

•  There  is  experience 
in  simplification  of  the  real— 
or  rather  too  real— images, 
like  in  the  case  of  airport  body 
scanners.24 


•  And  last  but  not  least  there  is 
a  tradition  of  roughly  seven 
years  of  masking  objects,  in¬ 
formation  and  people  on 
Google  Maps:  This  raises  the 
issue  of  banalization  of 
masking  as  a  process.  For  ex¬ 
ample,  to  hide  military  bases, 
Google's  designers  use  the 
"crystallization"  filter,  known 
and  available  to  everyone,  be¬ 
cause  it  is  a  default  filter  in 
every  image  processing  soft¬ 
ware.  So  the  act  of  masking 
doesn't  appear  as  an  act  that 
could  rise  political  and  ethical 
questions,  but  as  one  click  in 
Photoshop.25 

Those  preconditions,  especially  the 
last  one,  made  me  think  that  some¬ 
thing  more  dangerous  than  the 
gamification  of  war  can  happen, 
namely  the  desktopization  of  war.  (It 
has  already  arrived  on  the  level  of 
commodity  computing  hardware  and 
familiar  consumer  operating  sys¬ 
tems.)  It  can  happen  when  experi¬ 
ence  designers  will  deliver  interfaces 
to  pilots  that  would 


22  PBS’  "Frontline”  series  covered  a  few 
projects:  Interview  with  Albert  Rizzo,  leader  of  Virtual 
Reality  Exposure  Therapy  at  the  USC  Institute  for 
Creative  Technologies  since  2005,  Frontline,  last 
modified  February  2, 2010, 
http://www.pbs.org/wgbh/pages/frontline/digitalnati 
on/waging-war/immersion-training/stress- 
inoculation.html?play.  Interview  with  P.W.  Singer, 
Frontline,  last  modified  February  2, 2010, 
http://www.pbs.org/wgbh/pages/frontline/digitalnati 
on/waging-war/immersion-training/virtual- 
training.html?play.  Report  on  a  Sargeant  going 
through  VR  assiset  PTSD  therapy,  Frontline,  last 
modified  February  2, 2010, 
http://www.pbs.org/wgbh/pages/frontline/digitalnati 
on/virtual-worlds/health-healing/a-soldiers-therapy- 
session.html?play. 


23  Since  201 1 ,  Nintendo's  handheld  video  game 
systems  series  3DS  features  a  built-in  game  called 
“Face  Raiders”  that  mixes  live  camera,  user  photos 
and  3D  graphics. 

24  See:  Tom  McGhie,  "Boffins  design  'modest' 
naked  airport  scan,”  Time  is  Money,  last  modified 
November  21, 2010, 

http://www.thisismoney.co.uk/money/news/article- 
1708293/Boffins-design-modest-naked-airport- 
scan.html.  Manchester  Airport  press  release  on  body 
scanners,  Manchester  Airport,  unknown  date, 
http://www.manchesterairport.co.uk/guides-to- 
travelling/security/body-scanners/. 

25  Crystallized  NATO  Airbase  Geilenkirchen  on 
Google  Maps, 

https://www.google.eom/maps/@50.960001 3,6.028 
254,1 21 3m/data=!3m1  II  e3. 
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Eraser  Tool  by  Madeleine  Sterr. 

Screen  Saver  by  Monique  Baier. 

complete  the  narrative  of  getting 
things  done  on  your  personal 
computer;  to  deliver  the  feeling  that 
they  are  users  of  a  personal  computer 
and  not  soldiers,  by  merging  classics 
of  direct  manipulation  with  real  time 
traumatic  imagery,  by  substituting 
the  gun  sight  with  a  marquee  selec¬ 
tion  tool,  by  “erasing1'  and  "scrolling" 
people,  by  "crystallizing"  corpses  or 
replacing  them  with  "broken  image” 
symbols,  by  turning  on  the  screen 
saver  when  the  mission  is  complete. 


We  created  these  drafts  in  the  hope  of 
preventing  others  from  thinking  into 
this  direction. 

Augmented  Reality  shouldn't  become 
Virtual  Reality.  On  a  technical  and 
conceptual  level,  interaction  design¬ 
ers  usually  follow  this  rule,  but  when 
it  comes  to  gun  sights  it  must  become 
an  ethical  issue  instead. 

Experience  designers  should  not  pro¬ 
vide  experiences  for  gun  sights. 
There  should  be  no  user  illusion  and 


no  illusion  of  being  a  user  created  for 
military  operations.  The  desktopi- 
zation  of  war  shouldn't  happen.  Let's 
use  clear  words  to  describe  the  roles 
we  take  and  the  systems  we  bring  to 
action: 


War 

UX 

HCI 

Gun 

Technology 

Computer 

Gun  Sight 

Experience 

Interface 

Soldiers 

People 

Users 

k  k  k 

I  look  through  a  lot  of  old  (pre  RUE) 
homepages  every  day,  and  see  quite 
some  that  are  made  to  release  stress, 
to  share  with  cyberspace  what  the  au¬ 
thors  can't  share  with  anybody  else, 
sometimes  it  is  noted  that  they  were 
created  after  direct  advice  of  a  psy- 
choterapist.  Pages  made  by  people 
with  all  kinds  of  different  back¬ 
grounds,  veterans  among  them.  I 
don't  have  any  statistics  about  if 
making  a  home  page  ever  helped  an¬ 
ybody  to  get  rid  of  combat  stress,  but  I 
can't  stop  thinking  of  drone  operators 
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coming  back  home  in  the  evening, 
looking  for  peeman.gif  in  collections 
of  free  graphics,  and  making  a 
homepage. 

They  of  course  should  find  more  ac¬ 
tual  icons  to  pee  on.  And  by  any 
means  tell  their  story,  share  their  ex¬ 
periences  and  link  to  pages  of  other 
soldiers. 
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